2024-01-05 10:24:34.AIbase.4.7k
Intel's Gaudi2 Technology Surpasses NVIDIA in Language Model Inference
Research shows that Intel's Gaudi2 technology competes with NVIDIA's AI accelerators in large-scale language model inference. The inference performance of Gaudi2 is comparable to NVIDIA's H100 system in decoding and surpasses that of the A100. According to public cloud pricing, Gaudi2 offers better value for training and inference compared to NVIDIA's A100 and H100. Intel's Gaudi3 is planned for release in 2024, promising four times the processing power and double the network bandwidth. Intel is committed to advancing high-performance computing and
